Model Name,Evaluated on,Experiment Date,Count,Model Size,F1 Score,BERT Score,Blue Score,SentenceSim Score,Meteor Score,Rouge Score,SimHash Score,Perplexity Score,Bleurt Score
Bert-Fine-Tune,CoQA,2023-06-08,894,,24.135412066279706,65.80002992269014,3.0711580482605707,53.40867701747203,25.74543450679794,26.980250920920312,26.129753914988815,21.106700178042065,-0.6726179532623398
FlanT5-XL,CoQA,2023-06-08,1000,3B,30.364942709698116,57.250804157230704,8.442296675285842,57.049054794519996,29.006842143157733,34.29760845612674,24.242,20.43834102281752,-0.4666654137521982
FlanT5-XXL,CoQA,2023-06-08,1000,11B,34.15703417466805,59.122396993140725,9.758095463518146,62.08597400425,31.768646056129064,38.79589976423024,23.672,20.183776953087502,-0.3958241667672992
Bloom,IBM-Test-Product-Wise,2023-06-12,59,176B,4.80394435249185,47.3050870672853,0.0051809594884328295,29.28619946818648,2.7063959833139424,6.159889279025209,29.53258579015659,9.248362118177132,-0.9580928895810674
Bloom,Manually-Curated,2023-06-08,20,176B,25.492804061454926,58.323079523895785,6.235225702205538,69.48325718,7.23658688,13.9853833,22.4,34.688504236610456,-0.4099286623299122
Coga,Manually-Curated,2023-06-08,40,3B,15.55680864412287,56.36738454912127,2.673912263902788,48.328377092500006,6.485398535000001,12.399896945,28.25,34.64649863697308,-0.5840777467936278
FlanT5,Manually-Curated,2023-06-08,40,3B,4.5158600887621345,52.799512667907344,0.3208395460558515,14.292150630750001,0.19398822000000002,0.1914962675,31.075,21.197732486696072,-0.8763953540474176
Flan_ul2,Manually-Curated,2023-06-08,40,20B,17.15978203782754,56.588369884999935,4.216839371730626,43.27737919,2.73268448,2.250723605,27.4,34.36102412119591,-0.6085604824125767
Bloom,QuAC,2023-06-08,1000,176B,15.428928708221019,46.919092257570334,2.3107525392673005,41.70466697666,12.349800102642151,17.567037065635176,28.32,13.715137162439106,-0.9716251518428326
FlanT5-XXL,QuAC,2023-06-08,1000,11B,47.80562290423245,64.4157400659924,34.259327606855045,62.26129018819,52.25332514801126,49.06698024605896,18.861,18.66993708698469,-0.2244473982155323
FlanT5-XXL,QuAC-Random,2023-06-08,1000,11B,43.319247017345944,59.40235001168157,28.97599667786913,57.656521869852995,39.40124633356364,44.47108922046092,20.433,13.125657576427765,-0.48647812519967554
Bloom,SAP-Doc-Solr,2023-06-08,101,176B,13.596648704491422,52.40175198682473,0.8692203424144759,51.78699136039604,11.647284397616463,16.806216673793248,25.693069306930692,24.009176214580187,-0.7163195970034836
Coga,SAP-Doc-Solr,2023-06-08,101,3B,11.78539289237878,52.26500919261628,1.0932971492237842,40.395073268316835,13.348204544793052,14.820595747371012,28.346534653465348,26.439306376986902,
FlanT5-XXL,SAP-Doc-Solr,2023-06-08,101,11B,13.255023403369446,55.67184235646635,0.9726746313902271,40.83828365346535,15.379507351161859,17.483120259245453,28.22772277227723,26.157920676927578,
Bloom,SAP-passages,2023-06-08,101,176B,23.0743906782968,55.53835704815535,5.112601215999598,62.329128491089115,17.231895468276505,24.79256791089477,20.85148514851485,23.39396286772889,-0.689271871406253
Coga,SAP-passages,2023-06-08,101,3B,40.84657227620341,65.42338382382975,20.137510631476154,66.22701804950492,42.656974728361526,42.91900033082335,20.217821782178216,23.455695208086713,-0.25231878857801454
FlanT5-XXL,SAP-passages,2023-06-08,101,11B,44.842100622829754,64.75961283007064,19.669152294447358,71.11681692079209,46.715969329503274,46.71170430813604,18.366336633663366,22.58076955448573,-0.19849374477225956
FlanT5-XXL,TidyQA,2023-06-07,1001,11B,34.906116287013994,46.847449755173486,11.118909975453514,58.58153532672327,23.946687868265673,35.56320742052817,22.04995004995005,4.727972740072189,-0.6267285945189821
